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nonparametric  distribution- free,  parametric  distribution-free-,  minimal 
sufficient  statistic,  maximal  statistical  noise,  Kolmogorov-Smirnov  statistic, 
basic  data  transformation. 


Detection  problems  for  uniform  renewal  processes  are  represented  in  the 
formats  of  GOF(goodness-of-flt),  2-sample;  and  GOF-with-nuisance-parameter 
problems*  The  techniques  are  all  based  on  the  minimal  sufficient  statistic 
or  its ^orthogonal"  complement.  The  statistics  employed  are,  for  the  most 


part,  that  of  Kolmogorov,  and  its  modification  by  L1111e£»rs 
Each  technique  is  illustrated  by  a  numerical  example,  XT 


I  lustrated  by  a  numerical  example. 
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SIGNAL  DETECTION  FOR  UNIFORM  RENEWAL  PROCESSES 
Y.  Gioi*,  C.  B.  Bell*,  R.  Ahead**,  c.  J.  Park* 
San  Diego  State  University* 
University  of  Strathclyde** 

State  University  of  New  York ,  Buffalo* 


1*  Introduction  and 
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A  najor  part  of  the  statistical  Methodology  in  signal  detection  is 
directed  towards  models  in  which  the  data  received  are  Gaussian  or  Gaussian- 
Mixture.  Under  these  Models  the  classical  statistical  techniques  and 
their  extensions  can,  in  essense,  be  adapted  to  signal  detection  problens. 


Another  important  set  of  fsadlitfe 


replacing  the 


These 


include 


Jrture  dssuaption  with  other  paranetric  ass^  r-ions. 
»i#s«#^reneiAii  processes ,  honsgeneoufe  Poles 


processes,  and  non-honogeneous  Poisktm  processes.  The  signal  detection 
Methodology  here  is  principally  parnaetric  in  nature. 

v  ^  P*PeroOT«iti*  to  investigate  signal  detection  techniques 
fbr  tiie  uniforu  renewal  processes.  The  other  two  cases  nauely  honogenaous 

.  *“*  ^55555?*  polsson  P*«ces*es  are  also  i^ortant  fro*  signal 

detection  viewpoint,  and  will  bo  dealt  with  elsewhere. 

.  The  feneral  signal  detection  problen  can  bo  treated  as  a  problen  of 
testing  statistical  hypotheses,  sss  Ball  (lg64).  In  practice,  detection 
is  accoaplished  by  nesns  of  e  device  which  receives  known  pure  noise 
&ML  pgalhie  signal  CPS)  date,  and/or  artificial  noise,  and  frou  these 
inputs  "decides"  (YES  or  NO)  whether  or  not  a  signal  is  present.  In 

2JL21LIS  *  *"  °*nc9  °*  »«v»l  Research 
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■•king  this  decision,  the  detector  is  liable  to  comit  two  types  of 
erraneous  outputs: 

(i)  false  alara  [PA),  if  NO  signal  is  present  and  it  decides  YES; 
and 

(ii)  false  dlsaissal  (FD) ,  if  YES  a  signal  is  present  and  it  decides 
NO. 

The  detection  procedure  can  be  seen  schematically  fro*  the  following 
diagram: 


The  probability  that  the  detector  will  produce  a  false  alara  (PFA)  will 
be  designated  by  a;  8  will  denote  the  probability  that  the  detector 
will  produce  a  false  dismissal  (PFD).  Obviously,  the  perfect  detector 
will  be  a  detector  which  will  produce  a  »  0  and  8*0;  but  this  has 
not  yet  been  constructed.  However,  there  is  a  considerable  interest  in 
the  so-called  ideal  or  optlaal  detector.  This  can  be  classified  into 
two  foras  as  given  below. 

(a)  Ideal  detector  with  given  a  priori  probability  p:  This  detector 
■iniaizes  the  probability  of  an  error,  either  FA  or  FD,  that  is. 


e(o,8,  p)  ■  pB  ♦  (1  -  P)a 


t 

where  p  denotes  the  a  priori  probability  that  a  signal  is  present; 

(b)  Ideal  detector  with  pre-chosen  PFA,  a:  For  this  case  the 
objective  is  to  choose  a  such  as  .001,  .01,  .05  etc.,  and  select  a 
decision  rule  (detection  procedure)  among  all  the  available  procedures 
which  minimizes  6;  in  other  words  it  naxinizes  ir  «  1  -  6,  the  power 
of  the  detection  procedure. 

Hie  first  type  of  detection  procedures  (statistical  tests)  are 
commonly  known  as  the  Standard  Bayesian  Detection  Procedures  (STOP);  and 
the  second  type  as  the  Classical  Detection  Procedures  (CPP).  If  p  is 
known  beforehand,  clearly  it  is  advantageous  to  use  the  first  type  pro¬ 
cedure,  otherwise  the  second  type. 

The  simplest  form  of  the  PS  data  received  by  the  detector  consist  of 
discretized  observations  (note  not  necessarily  discrete  values)  XJt  X2,  ...,  X^ 
of  a  uniform  renewal  process,  which  is  a  continuous  time  process,  at  times 
t^,  t2,  ...»  t  .  To  obtain  optimal  detectors,  the  following  assuaptions 
are  made  on  the  succeeding  statistical  analysis. 

(i)  The  random  variables  X^,  X2,  . ...  X^  are  statistically  inde¬ 
pendent; 


(ii)  Xj,  X2,  ...,  Xn  have  a  conmon  strictly  increasing  continuous 
cumulative  probability  function  (cpf)  F  such  that  F(x)  ■  P(X^  <_  x) . 
(For  the  uniform  renewal  process  it  is  clear  that  the  cpf  F  is  monotone 
non-decreasing  and  F(0)  *  0  and  F(+»)  *  1.) 

(iii)  If  the  PS  data  are  PN  (pure  noise),  then  F  •  P0;  a  specified 
uniform  renewal  process  (URP)  cpf;  and  if  the  PS  data  are  noise- 
plus-signal  (N  ♦  S)»  then 


|  -  -  P 
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or 
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P  ■  Pj  j»  PQ,  where  Pj  is  still  URP  cpf  but  different  fro*  PQ. 

The  iaplications  of  the  various  assumptions  are  discussed  in  detail 
in  Bell  (1964)  in  connection  with  the  signal  detection  problem.  With 
the  above  preliminary  considerations,  it  is  now  possible  to  introduce  the 
three  major  statistical  models  of  detectors  to  be  investigated  in  sub¬ 
sequent  sections. 

MODEL  1::  PNjt  -  The  pure  noise  cpf  FQ  £  U(0»  0Q),  0  <  0Q  <  is 

known  and  there  are  available  PS  data  X^,  X^,  ...» 
whose  cpf  Pj  5  U(0,  8j),  0  <  0j  <  •,  is  unknown. 

In  this  case  we  want  to  detect  the  null  hypothesis; 
f^CPNj);  8  ■  0Q  against  alternative;  H^CN  ♦  S): 

6  i  0Q.  One-sided  versions  of  the  alternative 
hypothesis  will  be  (i)  H*(N  ♦  S):  0  >  8^,  or 
(ii)  H‘(N  ♦  S):  0  <  0Q. 

MODEL  II:  PN2:  The  problem  here  consists  of  having  an  ideal  detection 

procedure  for  Hq[F  •  0(0,0);  0  unknown]  against 

Ht[P  i  U(0,8)]. 

MODEL  III:  PNj:  In  this  case  the  basic  data  (BD)  set  is 

Z  •  (Xj,  X2,  ...,  X^;  Yj,  Y2,  ....  Yn)  or 

(Yj.  *2,  •••*  Vl»  V2*  **'*  Vn^* 

VV-  **J  "*  VYi*"‘V 

X  *  U(O,0j)  and  Y-v  U(O,02),  where  Bj  and  02  are 
unknown. 
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We  want  a  detection  procedure  for  H0(PNj):  8j  ■  02 

against  HaCN  ♦  S) :  +  02«  Similarly,  one  can 

define  H*(N  ♦  S):  0.  >  0,  and  H'(N  +  S) :  0,  <  0,. 

a  i  *  a  l  z 

Since  the  underlying  process  is  a  uniform  renewal  stochastic 
process,,  instead  of  the  probability  distributions  FQ,  F^,  F2  etc.  We 
shall  reformulate  our  null  and  alternative  hypotheses  in  terms  of  pro¬ 
bability  laws  XQ,  Xv  X2  etc*  is  done  in  section  three  when 

tile  suitable  detection  procedures  are  discussed. 

The  organization  of  the  paper  is  as  follows. 

In  section  two  basic  statistical  concepts  are  briefly  outlined.  Next, 
in  Section  three  optimal  detection  procedures  for  (i)  PNj  versus  N  ♦  S 
and  (ii)  PN2  versus  N  +  S  are  developed.  The  detection  statistics 
here  are  of  the  Kolmogorov -Smirnov- type,  Lilliefors-  and  Srinivasan-type, 
and  some  which  are  based  on  maximal  statistical  noise.  In  Section  four 
PNg  versus  N  +  S  is  dealt  in  detail. 

2.  Basic  Statistics  Concepts 

Let  Xj ,  X2,  . . . ,  Xn  be  independent  identically  distributed  random 
variables  with  probability  distribution  function  F(x),  and  set 
W_  ■  X,  ♦  X,  +  ...  ♦  X_  for  m  ■  1,  2,  ...»  n  with  Wft  =  0.  In 

lid  B  U 

stochastic  processes  terminology  we  say  {Wn,  n  >_  1}  is  a  renewal 
process  and  {Xn,  n  ^  1}  is  the  dual  inter-arrival  time  process. 

In  the  sequel  we  assume  F(0)  ■  0;  of  course,  one  could  allow  an  atom 
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at  the  origin,  but  nothing  would  be  gained  and  we  would  have  to  exclude 
the  case  of  a  distribution  F  concentrated  at  the  origin. 

Definition  2.1.  If  Xj,  X2,  ...»  X^  are  independent  identically  dis¬ 
tributed  U(O,0)  random  variables,  then  the  process  N.,  If, ,  ...,  W. ,  .. 

i  12) 

with  H,  -  )  (W.  =  0)  is  called  the  uniform  renewal  process 

3  i-i  1  0 

(URP). 

The  random  variable  denotes  the  waiting  time  to  the  jth  event. 
Let  fi(URP)  denote  the  family  of  all  uniform  renewal  processes'  pro¬ 
bability  distributions,  that  is 

ft (URP)  -  (F(* ) :  F  -  U(O,0),  0  >  0}. 


Consider  the  situation  like  models  PNj,  PN2  end  PNj  in  which  the 
data  received  is  X  •  (X^ ,  . . . ,  X^)  or  Z  ■  (X^ ,  •  •  * ,  X^j  Y j ,  . .  • ,  Y^) . 
For  many  practical  situations  the  decision  as  to  idiether  a  signal  is 
present  or  not  is  optimally  based  on  the  data  solely  through  the  minimal 
sufficient  statistics  M-S-S,  SQp  or  S(Z).  However,  in  many  other 
situations  one  needs  a  quantity  complementary  to  the  M-S-S;  this  is 
called  the  maximal  statistical  noise  (M-S-N)  and  is  denoted  by  NQC) 
or  N(Z)  depending  upon  the  model  in  the  problem.  In  what  follows  we 

write  Z  for  the  generic  data  point. 

% 

(A)  Basic  Data  Transformation  and  Maximal  Statistical  Noise 


Definition  2.2.  Let  6(Z)  «  (N(Z),  S(Z)j  be  one-to-one  almost  everywhere 


l-.’W.j.-.rjr-l' 
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with  the  M-S-S,  S(Z),  and  the  entity  N(Z)  be  statistically  independent 

of  S(Z).  For  the  family  of  interest  ft(URP),  (i)  6(Z)  is  called  the 

basic  data  transformation  (BDT);  and  (ii) ,  N(Z)  is  called  the 

% 

maximal  statistical  noise  (M-S-N). 


Example  2.1.  Let  Xj ,  X2 ,  . . . ,  Xn  be  the  inter-arrival  times  of  URP 

in  the  family  ft  (URP) .  Then  the  maximum  likelihood  estimator  for  8 

is  0  »  X, ... ,  the  largest  order  statistic  of  the  generic  data  point. 

W 

Clearly,  M-S-S  is  X^  and  a  uniformly  minimum  variance  unbiased  estimate 

■ut 

for  0  is  0*  -  ( - )X,  ...  Now,  the  vector  of  random  variables 

m  imj 


V*  *  CV*  v*  V*  )  *  {  Cl)  C2) 

J  *»'  2 . Vl  x(.)  ’  x« 


•••I 


%ii) 

w 


is  not  a  M-S-N.  However,  the  augmented  vector  variable  defined  by 


(V*,  R)  -  (Vf,  ....  V*  ;  R(X  ),  ....  R(X  )} 

<vi  %  i  m-i  i  a 

is  indeed  M-S-N,  here  R(X^)  denotes  the  rank  of  the  random  variable 
Xj  for  j  *  1,  2,  ...,  m. 

(B)  Types  of  Distribution- free-ness 

There  are  three  distinct  types  of  distribution-free  statistics  which 
arise  for  many  types  of  detection  problems. 

Definition  2,3.  (i)  A  statistic  T(jZ)  is  called  nonparametric  distri¬ 

bution-free  (NPDF)  w*r*t«  a  family  ft*  of  stochastic  processes  if  there 
exists  a  single  distribution  function  Q(*)  such  that  for  all  probability 


mm 

ttfi 

■*  m*i-  ■*• 

«*v> 

a.;> 

* mfr 

V'.fpi;f; 

mm-wmm 

K  ■■• 

■L-*.  A.  > 

against  Hft:  0  >  0Q  any  test,  $(z) >  is  uniformly  most  powerful  (UMP)  at  the 
significance  level  a  for  which  Ea  d(Z)  *  a,  Ea  $(Z)  <  a  for 

Oq  i\,  o  — 

6  <  8_;  and  <|>(Z)  »  1  when  X,  ,  *  max(X. ,  X  )  is  greater  than 
—  U  r\j  t,mj  l  in 

0Q  and  zero  otherwise  [Lehmann  (1959,  p.  110)]. 

For  detecting  HQ:  9  ■  0Q  against  0  0Q  a  unique  UMP  unbiased  test 
exists  and  is  given  by  $(Z)  *  1  when  X^  >  0Q  or  X^  £  0Q  m vST  , 
and  4>(Z)  ■  0  otherwise.  Similarly,  a  IMP  detection  procedure  for  the 
case  Hp :  0*6^  against  Hft:  0  <  0Q  can  be  developed  and  combined  with 

the  one-sided  case  discussed  above.  [Note : A  variation  of  the  first 
situation  is  PNj  versus  N  ♦  S,  that  is  Hq:  X  B  e  R(URP)  versus 
V  *<%  (where  <*  indicates  that  X^is  stochastically  larger  than 
);  and  the  second  case  for  URP  becomes  against 

(iJf  e  fl(URP)).] 

Remark  3.1.  Consider  Y, ,  ....  Y_  to  be  a  random  sample  from  the  family 

1  "  1  “  X  ID 

of  two-parameter  exponential  densities  given  tr 

{f(x;  a, 6)  -  ae'o(x‘0),  x  >  B). 

-oY 

Clearly  (X. ,  . . . ,  X  )  with  X .  >  e  J  is  a  random  sample  f rom  the 
l  m  j 

uniform  distribution  U(0,  e"°®).  Now,  one  can  easily  develop  the  UMP 
detection  procedure  for  :  B  *  Bq  against  H^:  B  ^  BQ  when  o  is 

assumed  known;  and  also  one  can  determine  the  UMP  detection  procedure 
for  (ayB)  ■  (a0,  BQ)  against  the  alternative  Ha:  a  >  a0,  B  <  Bq. 

Remark  3.2.  Suppose  that  in  a  detection  problem  we  are  interested  to  detect 
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that  certain  signals  (events)  occur  uniformly  over  a  stated  time  interval 
such  as  (say)  35  minutes,  one  hour,  one  day  etc.  If  the  total  time 
interval  is  divided  into  N  equal  parts  and  p^.  denotes  the  probability 
of  an  occurrence  (presence  of  a  signal)  in  the  jth  subinterval,  the 
detection  problem  becomes  HQ:  p^  »  N_1  for  j  *  1,  2,  ...,  N  against 
the  alternative  p^  j*  N_1  for  j  »  1,  2,  ....  N.  Then  the  detection 

rule  can  be  based  on  the  statistic  (a  chi-squared  statistic) 

T*«mN  l  (q.  -  N'V 

j-1  3 

where  q^  is  the  relative  frequency  of  a  signal  occurrence  in  the  j  th 
subinterval.  Ihe  approximate  power  of  the  detection  procedure  is  given 
by  the  probability  of  rejection 

(«;  X2)da>, 

2 

where  XjjjO;  X)  is  the  noncentral  chi -squared  density  with  N  -  1 

2  N  j  j 

degrees  of  freedom  and  noncentTality  parameter  X  *  mN  £  (p.  -  N  )  . 

j-1  3 

Here,  the  critical  point  c  is  determined  by  the  expression 

XjJ_j  (to) dm  -  a 

under  the  null  hypothesis. 

Remark  3,3  [Lehmann  (1959,  p.  309)] 

Suppose  that  in  the  above  set-up  (Remark  3.2),  where  the  hypothesis 
of  uniform  distribution  is  being  detected,  the  alternatives  of  interest 


are  those  of  cyclic  movement  (perhaps,  not  an  unusual  situation  in  some 
signal  detection  problems),  which  may  be  represented  at  least  approximately 
by  a  sine-wave  function 

,  f2rri/N 

p,  *  N_1  +P  sin(w-6*)dw,  j  =  1,2,  ...»  N 

3  '2ir(i-l)/N 

Here,  p  is  the  amplitude  and  0*  the  phasing  of  the  cycle  disturbance. 

By  setting  €  ■  pcos  0*,  n  *  psin  0*  one  gets 


,-l 


Pj  *  N  *(1  +  a^  ♦  b^n) 


where 


a,.  »  2N  sin  ^  sin(2j  -  1)  ^  , 
b^  »  -2N  sin  ^  cos(2j  -  1)  ^  . 


N 


The  quantities  £,  n  which  minimize  N  [  (q,  -  p.)  (subject 

j»l  3  3 

fact  that  equations  for  p^  define  a  surface)  are 


to  the 


N 


N 


N 


N 


£  -  N  l  a  q  j  l  at  i  n  »  N  £  b  q  |  l  b2  . 
j-1  33  j«l  3  j-1  3  3  j-1  3 

For  N  >  2,  after  some  algebraic  simplification  the  detection  rule 
becomes 

N  ?  N  9 

2m[  l  sin(2j  -  1)  J]  ♦  2m[  l  q,  cos(2j  -  1)  SA  >  c 
j»l  3  N  j-1  3  N 


where  the  number  of  degrees  of  freedom  of  the  left-hand  side  expression,  a 


chi -squared  statistic,  is  d  ■  2.  The  noncentral  parameter  determining 
the  approximate  power,  that  is  for  fixed  PFA  a  minimizing  PFD  6  for 
N  +  S  alternative  cpf  Fj,  is 

X2  ■  m(£N  sin  -)2  ♦  m  (nN  sin  ^)2 
-  mp2N2  sin2  J  . 

Now,  we  return  to  the  uniform  renewal  processes  with  given  inter- 
arrival  times  when  the  underlying  parameter  becomes  a  nuisance  parameter. 

(B)  The  Kolmogorov-Sairnov-Type 

Detection  Procedures  for  Renewal  Processes  with  Uniform  Inter¬ 
arrivals  (Nuisance  Parameters  Case) 

The  object  here  is  to  develop  the  Kolmogorov-Smimov-type  detection  pro¬ 
cedures  for  "H0:  F  »  U(0,6)  for  some  6  >  0",  that  is  the  case 

PN. :  Jf_  e  fl(URP),  where  X.,  X.,  ...,  X  ,  ...  are  the  interarrival  "times 
l  r  1  z  m 

of  a  renewal  process  with  distribution  law  =  % 

If  the  value  of  8  were  specified  as  0Q  then,  in  addition  to 
statistics  employed  in  section  (A),  a  natural  Kolmogorov-Smirnov  statistic 
is 


Dn  -  sup  | F(x,  0O)  -  Fb(x) | , 


where  F_(x)  is  the  sample  cpf.  However,  in  the  situation  under  dis- 
cuss  ion  the  value  of  8  is  unknown,  and,  therefore,  0  is  a  nuisance 
parameter.  In  the  case  of  nuisance  parameter  structure,  we  define  two 


variants  of  Kolmogorov-Smimov-type  statistics.  These  are  called,  res¬ 
pectively,  Lilliefors-type  statistics  and  Srinivasan-type  statistics; 
see  LilliefOTS  (1967,  1969),  Srinivasan  (1970)  and  Lieberman  and 
Resnikoff  (1955)  for  some  special  cases. 

Definition  3.1.  (i)  Let  Z  *  (X,,  ...,  X_)  be  a  random  sample  with  dis- 

————————  i  n 

tribution  function  Fa,  and  let  F  fx)  be  its  sample  cumulative  dis- 

v  n 

tribution,  where  0  is  unknown.  The  statistic 

D  -  sup  !£0(x)  -  F  (x) |  , 

where  F0(x)  is  the  maximum  likelihood  estimator  (MLE)  of  F0  (x) , 
is  called  Lilliefors-type  statistic. 

(ii)  With  the  same  notation  as  above,  the  statistic 

\  *  si?)  |Fb(x)  -  F0  (x)|  , 

where  ?0(x)  ■  E{S(Xj)|T)  with  S(Xj)  -  Ijx  <  x  }  »  the  indicator  function, 

and  T  as  a  sufficient  statistic  for  6,  is  called  Srinivasan-type 
statistic. 

The  above  two  types  of  statistics  are  examples  of  NPDF  statistics 
w.r.t.  an  appropriate  family  of  distributions  ft*,  such  as  (normals), 
(exponentials),  and  ft(URP). 

Let  a  probability  law  ^Q(X;  0j,  ©2»  •••»  9^)*  **/»  with  dis¬ 

tribution  function  FQ(x;  0^  ...,  0fc)  be  such  that  Tj,  Tj,  ...»  Tfc 
are  the  joint  sufficient  statistics  for  the  vector  parameter  0  »  (0j,  ...»  0fc 


For  a  fixed  real  Xj  define  the  random  variable  S(Xj)  -  I^x  <  x  p 


where  1^  is  the  indicator  function  of  the  set  A.  Clearly  S(Xj)  is 
an  unbiased  estimator  of  FQ(x ;  0j,  02,  . . . ,  0^)  under  F  *  FQ. 
Consequently,  from  the  general  theory  of  sufficient  statistics  it  follows 
that  the  statistic 


?e(x)  «'B(SCX1)|T1,  ...»  Tk> 


is  an  unbiased  estimator  of  Fn(x;  6)  with  a  smaller  variance  than  S(X.) 

U  %  1 


If  in  addition  (Tj,  ...»  T^)  are  complete,  then  F^(x)  is  the  unique 

MVUE  of  F.(x;  0).  If  the  distribution  of  statistics  like  6  or  ft 
u  'v*  mm 


does  not  depend  on  6,  then  a  statistic  of  this  type  would  be  an 

'V 


appropriate  statistic  for  detecting  a  composite  hypothesis  P. 

Now,  we  specialize  these  statistics  to  the  case  of  renewal  processes 
with  uniform  interarrivals,  where  the  nuisance  parameter  is  0  >  0. 


MODEL:  PNj. 

In  the  treatment  of  signal  detection  problems  the  objective  here  is 
to  detect 

PN-:  (Z)  e  fl(URp)  against  (N  ♦  S):  Z )  $  ftfURP), 

•  *v 

where  z  -  (X.,  ...»  X_)  are  the  interarrival  times. 

'vi  m 

Recall  that  the  general  rule  in  constructing  detection  procedures  for 
problems  like  PN^,  PN2  and  PNj  is: 

(i)  to  use  the  W-S-S  when  the  PN  formulation  entails  a  completely 
specified  stochastic  process  law  (as  in  the  case  with  MODEL  1:  PN.),  and 


(ii)  employ  the  M-S-N  when  the  PN  formulation  entails  membership 
in  a  family  of  stochastic  processes  laws  (this  will  be  the  case  for  PN2 
and  PN3) . 

(a)  Lilliefors-TVpe  Detection  Statistics 

This  statistic  was  earlier  defined  to  be  of  the  fora: 

-  sup  |Fq  (x)  -  Fa(x)|, 

A 

where  Fg(x)  is  the  MLB  of  Fg(x),  and  F^fx)  is  the  cumulative 

saaple  distribution,  that  is,  F  (x)  *  (nuaber  of  X’s  <  x)|a  » 

a  1  J  e  (x  -  X,),  where  e(u)  »  1  if  u  >  0  and  zero  otherwise. 
j-1  3 

The  MLB  of  0  is  X^  *  max(Xj,  ...,  XB),  which  also  happens  to 
be  M-S-S.  Note  that  T  =  X^  is  an  example  of  a  PDF  statistic  and 
T(Zj  )  *  X  J  0  is  an  example  of  a  NPDF  statistic.  Clearly,  we  have 


Fft(x) 


0  if  x  <  0, 


X(m)  '  °-X-X(») 


1  if  x  >  X. 


Therefore,  the  Lilliefors  type  detection  statistic  can  be  written  as 


-  sup|FB(x)  -  Fg(x) | 


i  j.  e  "  -  *0)1  -  TTT-1 


sup  I  r  l  C  [X  -  XmJ  -  -3 - 

0<x<x ,  .  "  j»l  13  3  A(a) 
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*  |  i  J  e  [y-5 - -ylli  ]  -  -JL_  | 

o±x<x(a)  *  j-1  *(■)  *(a)  *(a) 

1  »-l 

■  sup  I  s  l  e  [u  -  U(j)]  -  u| 

0<u<l  "  j-1 

when  u  -  x/X^  and  and  ^  Mans  "it  has  the  ssm 

probability  JC  or  distribution". 

Before  we  give  the  actual  decision  rule,  we  sun  up  the  basic  dis¬ 
tribution  structure  as  below. 

Theorea  3.1.  Under  H^CFN^) ,  the  following  are  valid: 

(i)  The  statistic  T(Z,  )  -  W  has  the  distribution  given  by 

<  u}  •  un,  0  <  u  <  1. 

(li)  If  R(Xj)  denotes  the  rank  of  X^  then  the  vector  variable 

R  -  [R(Xj) ,  ...»  RCXg)]  is  distributed  uniformly  over  the  oerautations  of 

{1,  2,  . ..,  ■}.  This  we  write  as  R  *  D  -  U{S  (1,  2,  ....  a)}. 

*\»  s 

(ill)  The  vector 

V*  •  {^-  ,  ...»  »  (V*,  ...»  V*  ,) 

*  (■)  (■)  1 

hts  thi  sw  liw  it  [U^^j  •  •  •>  * •  * •  l 

i.i.d.  randon  variables  froa  U(0,1).  That  is,  V*  ^  ^u(l)»  •••»  U(»-i)5 

where  is  the  jth  order  statistic. 

Decision  Rule.  For  detecting  PN2:  e  fl(URP)  versus  N  ♦  S:  Jf  $  fl(URP) 
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Si 


S 


* 


« 


decide  N  ♦  S,  if  and  only  if,  6„  >  d*,  where  P(D  <  d*}  ■  1  -  o, 
and  a  *  P  {False  Alan). 

Ulliefors  (1967,  1969)  have  given  som  critical  values  in  other  cases 
but  not  for  a  uni fora  renewal  process.  Choi  (1981)  has  computed  some  tables 
for  this  case.  However,  we  give  in  the  Appendix  an  iaproved  version  of  Choi 
table  which  can  be  used  in  practice  as  well  as  soae  illustrative  examples. 


(b)  Srinivasan-Type  Detection  Statistics 

Consider  the  saae  detection  problem  as  in  stri>section  (a)  above. 

This  type  of  statistic  (other  than  URP)  was  originally  suggested  by 
Lieberaan  and  Resnikoff  (19SS)  and  later  on  Srinivasan  (1970)  investigated 
soae  cases  in  detail.  Here,  the  statistics  is 

0^  »  suplF^x)  -  F0(x)| 

where  F0(x)  is  the  MVUE  (ainiaua  variance  unbiased  estimate)  of  FQ(x) . 
If  JC  e  12 (URP),  then  by  the  theory  of  sufficiency,  one  gets 


Fe(x)  -  <  x]lX(«)} 

»  P{Xj  <  xlX(i|)} 

■  " 1  X  p(Xi 1  x|xC-)1 


•  -'l  X  P(XC»  i  *lx(.p 

■  " 1  'X  P(X(J) 1  x|*w)  *  P(X(»)  -  x|X(-),) 


-1 


■  ,1  •'(*«)  i  *'*(.)> 


Finally, 


'X# 

00 


r.a-1  X 

a  X 


0  <  x  <  X 


1. 


(■) 

X  ~  *(«) 


(■) 


L  0,  otherwise. 


Consequently,  the  detection  statistic  of  this  type  becoaes 


suplF^tx)  -  ?0(x)| 


a-1 


sup  |  a”1  l 
j-1 


°^X(a) 


e  [_* - Jil]  .  (5iL) 


(a) 


(a) 


_  *  ,  B-l 

•  sup  (~)  I  (—1)"  l  t  [(u  -  uf,J  -  u]|. 

0<lKl  ■  j-1  137 

%  X  «-i 

Thus,  we  note  that  the  detection  statistic  «  (~-)D  the 

Xolaojorov-SaiTnov  statistic  with  size  a-1,  for  all  a  >_2  provided 
N^(PN2):  <jfe'Q(URP)  holds. 

Decision  Rule.  For  detecting  PN_:  JT  e  ft(URP)  against  N  ♦  S:  $  0(URP); 

%  %  %  % 

decide  N  ♦  8,  if  and  only  if,  >  d,  where  P{Da  <  d)  ■  1  -  o,  and 
a  is  PFA. 

Srinivassn  (1970)  computed  critical  values  for  the  noraal  and 
exponential  cases,  and  Choi  (1981)  for  the  unifora  Case.  For  critical-  values 
in  connection  with  detection  statistic  D^,  one  can  use  the  standard  Kolaogorov 
Saimov  table  through  the  relation  D  ■  (*  ~  -)D  . . 
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(c)  A  Detection  Statistic  Based  on  Maxiaal  Statistical  Noise. 


We  have  already  defined  a  M-S-N  statistic,  N(Z),  in  definition 

% 

2.2.  For  the  URP  case,  that  is  for  PN2:^(e  ft(URP)  the  Maximal 
statistical  noise  (M-S-N)  statistic  is 

(V\  R)  -  (VJ,  V* . V;_jj  Rj,  ...»  Ra) 

lSS-11  ;  R(X.),  ...»  R(X  )  J, 

X(»)  X(»)  1  * 

where  R(X^)  denotes  the  rank  of  X^.  Note  that  in  PN2  situation  we 
have  a  NPDF  structure  for  the  underlying  statistic  idiidi  leads  us  to  the 
natural  detection  statistic  candidate  (V*.  R).  FUrtheraore,  we  shall  see 
that  if  a  detection  procedure  does  not  involve  the  parameter  in  the  aodel 
under  consideration,  then  it  is  solely  based  on  M-S-N  statistic.  This 
Motivates  one  to  define  a  third  detection  statistic  D*  as  follows: 

D*  -  sxip  |(a-l)  l  t  (u  -  um)  -  u|, 

■  0<u<l  j»l 

where  u  *  x|X^  and  ■  X(j)/X(a).  Obviously,  D*  is  the  statistic 

which  is  based  on  M-S-N,  (V*,  R*).  The  statistic  D*  has  the  Kolaogorov 
Snimov  distribution  for  a  saaple  of  size  a  -  1,  that  is,  D*  *  Dft  ^ 
under  PN2 : X  e  O(URP) .  For  critical  values  one  can  use  the  standard 
K-S  table  with  the  saaple  size  a  -  1. 

Decision  Rule.  For  detecting  PN 2:#jfe  n(URP)  versus  N  ♦  S:/f$  8(URP); 
decide  N  ♦  S,  if  and  only  if,  D*  =  D^j  >  d  where  HD^j  <  d>  ■  1  - 
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and  a  *  P  {False  Alara}. 

In  essence,  the  detection  procedure  structure  for  the  Model  II:  PN2 
can  be  summarized  by  the  following  result. 

Theorem  3.2.  Under  fl(URP): 

(i)  D*  -  0i4,  for  m>2; 


(iiD  D. 


-  c-oVi*  for  a11  ui2‘ 


(iii)  6  »  sup  |  (”■)  F  ,(u)  -  u|  ,  where  F  _  (* )  is-  the  saaple  cof 

■  o<u<l  *  ■-1 

based  on  Uj,  ....  u  j  which  are  i.i.d.  U(0,1). 


Proof.  (i>  This  is  an  immediate  consequence  of  the  fact  that  (V*,  ....  V£_j) 
has  the  saw  distribution  as  the  (a  -  1)  uniform  order  statistics 


(u(» . V-  ,  see  theorem  3.1  part  (iii). 


«  -  U 


(ii)  That  has  the  saw  distribution  as  C~u — ^)p|>_1  follows 


from  the  fact  that: 


D  «  sup  1  “  l 

>•* 


I  «  _I_  e  "  xm^  ~  m  ^  x,  -  ^ 


sup  (—^Jlrrr  l  e(u-Um)-u| 
<  u  <  1  *  B  1  j-l 


idiere  u  -  ^X(>)  and  U(J)  -  X(j)/X(ii). 

(iii)  Clearly, 


z 


I 


sup  I  r  2  e  (z  -  X.)  -  -= — 
oi*±x(B)  j-1  (j)  X(») 

sup  |I  \ 

°±Z<X(*)  j-i  XC)  x(«)  x(») 

,  B-l 

sup  '  I  J  I  e  (u  -  Um)  -  u| 

0  <  u  <  1  "j-l 

*up  !(—■)  F  ,(u)  -  u|, 

0  <  u  <  1  *  9rX 


where  Uj,  U^,  ....  U  j  are  i.i.d.  U(0,1) .  Hits  establishes  the  theorem 
Since  -►  1  as  it  follows  that: 

% 

Theoren  3.3.  Asymptotically  (as  a  *  <•)  the  statistics  D*,  D  and 
have  the  saae  distribution  as  the  usual  Kolmogorov- Snimov  statistic  D  . 


4.  Detection  Procedures  for  MODEL  III:  PNj 

Hie  received  basic  data  (BD)  set  is  ^  -  (Xj,  X^;  Y^j,  •••#  YB)n! 
(Zj,  ...»  Z^) .  Hie  detection  problem  for  tills  situation  is 

HoCPNj):  X1  e  S1(URP),  i  -  1.  2), 


against 


HB(N  ♦  S):  /j  ^  e  fl(URP),  i  •  1,  2), 


For  this  case  the  natural  detection  statistic  will  be  a  NPDF  statistic 
and  should  depend  on  the  M-S-N,  N(Z)  -  (V*,  R),  where 


o> 
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<r*  y  *  (vi*  v$ . vn-i;  ri*  r2- 


v 


,  7^-,  ....  R(Z  ),  ...,R(Z)} 

(N)  Z(N)  Z(N)  1  N 


Under  HQ,  Z,  -  (Z^,  •••»  Z(N)^  an(*  R  ar«  independent  since 
one  can  write  their  joint  p.d.f.  as  equal  to  the  product  of  the  Marginal 
p.d.fs.,  that  is, 

£  <*•>•<» -*,  ftcoJ-W 

2(0  «(•)  ' 

Note  that,  under  1^, 

%.,<&•)>  * "  j,  .sv» 

where  A  *  •••,  z^^ji  0  ^  z(l)  ^  ^"(2)  ^  •••  ^  Z(N)  —  ®  *  ®j  * 

and  R  is  distributed  uni fomly  over  the  pernutation  set  {S^Cl,  2,  N)}, 

Purthernore,  Z^  and  V*  are  independent;  and  so  are  R(|Z)  and  V*. 

In  *v \s  case  we  shall  develop  the  likelihood  ratio  detection  procedure, 
and  show  that  the  resulting  detection  statistics  is  based  on  the  naxinal 
statistical  noise  (K-S-N),  N<£)  -  (V*.  R). 

(a)  Likelihood  Ratio  Detection  Procedure 

Let  »  {(8j,  02):  ®i  "  ®2  "  ®i  >  °»  1  “  *»  “»* 

flj  ■  {(0j,  02):  0j  J*  ®2»  >  °»  i  *  1*  2).  Define  the  set  0*,  instead 

of  Oj  when  we  replace  "0J  >*  02”  by  ”®j  >  *2"’  **** 
is  defined  by  replacing  “0J  i  02"  by  "02  >  0j".  Now,  in  PNj 


situation  we  can  detect  for  three  distinct  cases: 


(i)  H(ftg)  against  H(flp,  a  two-tailed  alternative; 

(ii)  H(«0)  against  H(fiJ),  a  one-tail  alternative; 

(iii)  H(fiQ)  versus  H(ftp ,  a  one -tail  alternative. 

We  shall  develop  the  case  (ii)  the  case  (iii)  is  similar,  and 
part  (i),  of  course,  combines  cases  (ii)  and  (iii)  in  the  alternative. 
The  likelihood  ratio  detection  procedure  principle  states  that  the 
decision  rule  is  base  on  "YES  N  ♦  S",  if  and  only  if. 


sup 

8  £  8j 


sup 

8  e  ft, 


L(t,  0) 


l(z,  e ) 


>  a  or 


<  b. 


where  the  existence  of  constants  a  and  b  is  guaranteed  by  the  likeli¬ 
hood  ratio  detection  theoiy.  For  the  case  (ii)  there  exits  a  constant, 
say  k,  such  that  by  the  L.R.T. 


k  < 


'W  ‘Wn 


[W 


-N 


Clearly, 


q*  . 


=  Q* 


Y(n)  *  Z(N) 
*(■)  "  Z(N) • 
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Iherefore  the  critical  region,  C*  can  be  written  as 

C(m)  <  Y(n) 


c.  .  ft,  <  *w  <  »w>  u 


w{k2  <  *«>TW)- 


Or, 


aax[X.  . ,  Yf  .] 

°*  9  {  Y(n)l  >  kl  *  Y(n)  *  Z(N)>  ^ 


*(■)  "  Z(N)}* 


(The  exact  expression  for  kj  and  k2  will  be  given  later  on). 
Finally,  we  can  write  the  above  expressions  as 


C*  -  {  .jj-W  yfolr  >  k*>. 
*intX^) ’  Y(n)T 


Let  T  ■  ■-j--rvva — v  'l  •  Before,  we  give  the  probability 
“"^(b)'  Y(n)j 


distribution  of  j  under  and  fl|  we  first  want  to  establish 

that  statistic  T  depends  on  N(Z)  »  (V*,  R).  For  this  write 


H<2  -  <r-  ?>  ■  <r-  a*- 

b*  -  nex  {R(Zj),  ...,  R(Za))  -  Bax  {R^}, 
n*  ■  nax  (RCZ^j).  ....  R(Zj,)}  ■  ■«  <Ry>- 
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Now,  notice  that 


Z 

Bin  Cz 


£S *1  , 
CN) 


(N) 


=  N 


[fm)  =  Z(NJ 


=  N. 


Thus,  we  conclude  that  T  =  max(V*  ,  V**),  which  shows  that  T  indeed 

m  n 

depends  on  N(Z),  the  maximal  statistical  noise. 


(A)  TT»e  Distribution  of  the  Statistic  T  under  12^. 

For  convenience  in  this  section  we  shall  set  X  *  X,  .  and  Y,  .  =  Y 

(»)  CnJ 

and  similarly  Z^  ■  Z.  First  note  that  t  >  1,  now 

H(t)  =  P{T  <  t}  =  P(T  <  t;  X  =  Z)  + 

♦  P(T  <  t;  Y  *  Z} 

=  P{|  <  t;  X  >  Y)  *  P{^  <  t;  X  <  Y} 

*  p{£  1  Y  <  X}  ♦  P{X  <  Y  <  Xt} 

*  1  Y  1  Xt >  "  p^  1  J  1  *>• 
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H(t;  flQ) 
man 


Or,  one  gets: 


f  if  g(y)dy]f(x)dx  ♦  f6 


0  •'x/t 


’0  •'y/t 


f(x)dx]g(y)dy 


r9  -  re 

J  [G(X)  -  G(|)]f(x)dx  ♦  j  [F(y)  -  F(£)]g(y)dy 


(t*  V  *  1  -  *' 


Hence,  H^Ct;  fiQ)  - 


r#.  t<i 
^  i  -  t'*,  i  <  t  < 


ro,  t<i 

Similarly,  H  ,  i  -  n 

n  0  L  i  .  -J-  f-E  +  JL]  i<  t< 

*  m+n  1  n  tmJ*  — 


(B)  Hie  Distribution  of  Statistic  T  under  BJ  (6^  <  6  .  ) . 

Let  the  notation  be  the  same  as  in  the  case  (A)  above.  Define  the 
sets  Aj  and  A2  as  follows: 

Aj  «  (T  <  t;  X  >  Y)  -  <  t;  X  >  Y}.  -  (Y  <  X  <  tY> 

Aj  -  (T  <  t;  X  <  Y)  -  {J  <  t;  X  <  Y}  {X  <  Y  <  tX). 

Hie  integration  region  to  co^iute  H(t;  H*)  is  somewhat  complex,  and 
therefore  we  explicitly  illustrate  it  in  the  two  diagrams  below. 


What  we  want  to  compute  are  the  following  probabilities: 


H(t;ft*) 


r  0,  t  <  1 


P(Aj)  ♦  P(A2),  l<t<^ 


L  P(Aj)  ♦  P(A2),  Q^<t< 


We  shall  consider  P(A2),  P(Aj)  with  restriction  1  <  t  <  ,  and 

01 

P(A.)  under  the  constraint  *=■  <  t  <  %  respectively. 


d y 


Pl^)  *  ij  ^  f(x)]  g(y)dy 

-  f2  [F(y)  -  f(£)] 

Jo  1  e!| 

■  i;  0  'Of  •  <¥<  ‘ 

-  |  t*  -  ‘‘I 

Under  the  Diagraa  (3) ,  we  obtain 

f02 

P(Ap  *  J0  fj  fCx)dx]  g(y)dy 

.  -  <jjj-  [t*  .  1] 


(1) 


(2) 


Next,  we  coapute  P(Aj)  under  the  Diagraa  (2) 


P(V 


f 1/1  [f7  f(x)dx]  g(y)dy  ♦  f02  [f° 

Jo  h  je1/t  V 


f(x)dx]g(y)dy 


'l/t 


After  some  simplification,  one  gets 


P(Aj) 


1 


n  r02.»  ,ei*m 

N  ^ 


(3) 


Finally,  combining  expressions  (1),  (2)  and  (3),  we  obtain: 


H(t;  ft*)  - 


0,  t  <  1 

6  6  0 

l  _  2.  f— 2.1*  t ”®  _  E  f— in  t”n  <  t  <  * 

1  n  lej'  z  n  le2J  *  - 


Detection  Decision  Rule.  For  detecting  PNji  X\  «  jf2  rfi  e  ft(URP) , 
i  «  1,2)  against  N  ♦  S:  i  X2»  Xi  c  ft(URp)i  decide  N  ♦  s»  if 

and  only  if, 

sup  |  dH(t;  1^)  <  a 

where  a  is  P  {False  Alarm).  This  test  is  optimal  in  the  sense  that 
it  minimizes  6,  the  PFD  among  all  detection  procedures  for  fixed  a. 
In  other  words,  the  above  detection  rule  maximizes  the  power 

1  -  P  {False  Dismissal)  ■  1  -  sup  [  dH(t;  ft?), 

'C *  1 


where  C*  is  the  complimentary  region  to  the  acceptance  region  C,  in  which 
one  decides  in  favor  of  PN,. 
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Similarly  one  can  devise  decision  rules  in  cases  ftp  against  QJ  and 
&0  versus  flj . 

It  turns  out  that  the  detection  statistic  T  is  equivalent  to  the 
statistic  Tj  ■  which  has  distribution  under  the  null  hypothesis 

as 

0<I<1 

H(z)  - 

L  1  -  5  *”n»  !£*<•• 

This  statistic  was  also  treated  by  Murty  (1955)  When  testing  two  uniform 
distributions  in  a  parametric  setting.  Rider  (1951)  for  the  same  parametric 
problem  gave  a  statistic  which  is  the  ratio  of  two  ranges.  The  detection 
statistic  proposed  by  Rider  has  less  power  than  either  of  T  or  Tj 
statistics.  Khatri  (1960)  investigates  the  problem  of  testing  the  equality 
of  parameters  in  k  uniform  populations.  Khatri  extends  previous  results 
by  Roy's  (1953)  union-intersection  principle;  again  this  is  in  a  parametric 
setting.  Some  critical  values  are  given  by  Murty  (for  n  •  10  •  m)  and 
Khatri  takes  larger  sample  sizes.  Barr  (1966)  also  gives  some  results  on 
testing  the  equality  of  uniform  and  related  distributions.  Another  equival¬ 
ent  statistic  to  statistics  T  and  Tj  is 


For  a  »  n,  the  three  critical  regions  given  below  can  easily  be  seen 
to  be  the  same.  Diese  regions  are: 
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C2  "  *T1  <  *2  0r  >  b2^ 

C*  -  (T  >  kj} 

Clearly  («0)"1/b  -  kj  -  b2  -  *  kj.  Thus  C*  =  C*  =  C*  .  Ibis  is 

also  the  case  for  a  $  n.  However,  if  the  critical  region  is  two-sided 
then  the  level  of  significance  will  be  2oQ  instead  of  aQ. 

The  power  of  detection  statistics  T  :  Tj  :  Tj  is  discussed  in  the 
following  exaaple  which  is  a  slight  nodi fi cation  of  thirty's  result. 

Exaaple  4.1.  Let  (Xj,  X2 . X^)  be  a  random  saaple  of  size  a  from 

the  faaily 

a,OI»)  -  </,:  f(x;  Jf,)  -  Ore*)-1  l(0  te.,Wi  T  >  U’ 

and  (Yj,  Y2,  ...,  Y#)  be  another  random  saaple  of  size  n  from  the 
class 

fljCURP)  •  (X2:  f(  ;  /2)  •  CO*)'1  I(0,e*)GO>. 

To  detect  PNji  -  X2  v*rsu*  H  ♦  S:  e  fij(URP)  and 

X2  e  fi2(l»P),  the  aost  powerful  detection  rule  is  obtained  by  the  likeli¬ 
hood  ratio  principle  via  statistics  T,  T»  or  Tj.  In  this  case  the  re¬ 
jection  region  is 

C*  •  (T.  >  t  Hot  (I.  <  t  >  •  C], 

1-01  1  A 


where  a  is  critical  level.  Hie  power,  it, 


“h,r*  ‘o  •  "/liTT-nla- 
of  the  test  is  given  by 

*  *  PH  ^Ti  t  “ 

If  0  <  t  <  1,  then  the  MP  detection  rule  has  the  critical  region: 

C  «  {T.  <  t  },  where  t  «  ml  ,  and  hence  the  nower  of  the  test  is 

l—o'  a  y  ■ 

K  «  P{T-  <  t  N  ♦  S> 

1  —  O' 

5<V-  ‘a<T<1 

>  •  5  ({->”•  *«>T 

a 

A  General  Expression  for  the  Power. 

If  we  are  detecting  H(P0)  ■  (Mfj,  Jf2):  Xj  “  Xj  e  against 

H(QJ)  -  {(J^,  Jf2):  I*  Jf2l  €  R(URP),  i  -  1,  2,  and  6j  > 

then  by  using  the  statistic  T  one  can  get  the  power  function  ir(6j,  ©2) 
as  below. 

Since  the  critical  region  is  of  the  fora  C*  ■  {T  ta>  where 
ta  ■  ,  the  power  function  of  this  UMPU  test  becoaes: 

Mt  >  ta)  .  j*,/*2  JHttjnj)  .  |  i%m  [(Jl)*  -  tj  - 

lO  12 

-i 


r  f  <T/V"-  1  <  T  <  *„ 

*•  1  ’  S  <VT)*-  T  »  V 


-  33  - 


and 


P(T  >  ta>  «  j*  dH(t;  ft*) 


0,  0, 

-  ■(— )n  t"n>  7T-  <  t  < 

l0„J  za  1  •  0n  -  O 


An  Alternative  Approach  which  is  Equivalent  to  the  Detector  Statistic  T. 

As  before  let  ftp  ■  {(0j,  02):  0j  *  02)  *»d  ftj  ■  {(0j,  02): 

0  <  0j  <  02  <  *}.  Let 


«  nax  {X1#  X2, 


X  ) 

■ 


{Yj,  Y2,  ....  Y^} 


Z(N)  “  [X(*)'  Y(n)^  *  *  +  n  “  N 


To  detect  H(ftQ)  ■  {(ofj*  :  ■  X2  e  versus 

H(ftJ)  «  {gf1#  tf2):  /j  i  Jf2;  c(i  e  ftfURP)  for  i  -  1,  2  and 
0j  <  02),  consider 


|Z(K)) 


(xC)lZ00) 


say. 


where  +  is  an  arbitrary  function  which  gives  rise  to  a  test  statistic 
T  by  the  (conditional)  L.R.  (likelihood  ratio)  principle. 

After  soae  computation,  one  can  show  that 


♦CTS)  -  I, 


o< 


■  X 


D-l 


I(o,e1)(x(*)^* 


x,  *  »-i 


•  *"!  (ij^)  lJ0TtO,  Ij.j  'V)’  *  N  ’(O.  «J0) 


®1  *  **(•)  <  ®2 


*(•)  9i*  "(o.ej)  ^t-)’ 


■-1 


N  (z*  11  *  N  I(0,«*(.))(*C))  * 


>1 


N  **■  ro.ei  1  • 


*(.)  (°»e> 


62  «  '(•)  <  *• 


Clearly 


f0*(x(-),Z(')) 


-  *  ♦(T_)  is  Monotone  decreasing  in  x,  . 

W)|2c)>  10 


hence  by  the  statistical  testing  theory  [Lehaumn  (1959)],  the  unifbraly 
ainiaua  FDR  unbiased  procedure  of  size  a  for  detecting  HCQq)  against 
H(O’)  is  given  by 

»•  “  X(.)ictZ(0) 

otherwise. 


♦(X 


o’  ■  [  *’ 

L  o. 


where  $(x^  satisfies 


a  . 


The  critical  region  is  obtained  by  the  expression 


or 


) 


ZCO 


m-1 

il 


al/B  (^1/B 


a 


If  we  develop  a  detection  procedure  this  way  for  detecting  HCAq)  against 
then  the  critical  region  turns  out  to  be  the  sane  as  for  the 
statistic  T.  Thus  the  test  based  on  Tj  given  is  equivalent  to 

the  detection  procedures  T,  Tj,  T2« 


Decision  Rule.  For  detecting  PN^  versus  N  +  S:  H(flJ) ;  decide 
N  ♦  S,  if  and  only  if. 


xw  ±  • 


1/m 


$ 


1/n 


*(•> 


9 


a  ■  P  (False  Alarn}. 

(Renark:  Detection  statistics  T,  Tj,  Tj,  Tj  are  all  SDF  wrt  H^).) 
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Illustrative  Exaaples 


Example  1:  Detection  procedures  for  Model  II:  PN2 


Given  a  set  of  historical  data :  X, ,  ...»  X  we  want  to  test  the 

l  m 

following  PN  situation: 


PN2:  JC  e  fl(URP) 

N  4  S:  Xi  ft(URP) 


Three  statistics  are  used  for  two  sets  of  simulated  data: 


(1)  Kolmogorov-Smimoy 

Decide  N  ♦  S  iff  D*  >  (from  K-S  table) 

i  ■-1 

D*  -  sup  |  - — j-  l  e  (u  -  U(j))  -  u| 

"  0<u<l  H  1  j-1 


where  U(j)  ■ 


(2)  Srinivasan- 


*\»  <Vt 


Decide  N  4  S  iff  D  >  d  •  (5~-)d_  .  _ 

m  m  ■■X|W 


sup  (5^-)  1-4  r  MU  -  U()))  -  u| 


sup  i— j  ijjjrr  L 
0<u<l  ■  ■  1  j-1 


C3)  Li 1 lief  ors -type 

Decide  N  4  S  iff  6  >  d*  C from  Table  1} 


1  *  f.t  *v  • a  ' 


6  »  sup  I  ~  l  e  (u  -  U(j))  -  u| 

0<u<l  ■  j-1 

*  max  [max{  j  -  U(j),  U(j)  -  >] 

l<j<m-l  " 

The  data  sets  are  given  in  Table  2.  The  graphs  showing  inter-arrivals, 
waiting  tines  and  counting  process  for  both  processes  are  shown  in  diagraas 
1  to  6.  The  computed  values  for  the  above  three  statistics  are  listed 
at  the  bottom  of  the  Table  2. 

Conclusion.  For  the  both  sets  of  data  all  detectors,  at  PFA  a  *  .01 
decide  in  favor  of  PNj. 

Note.  For  m  greater  than  30  the  exact  Kolmogorov- Smirnov  statistic 
asymptotic  values  are  adequate  to  approximate  6^  when  m  >  SO. 

For  example. 


PFA  o: 

.01 

.05 

.10 

.20 

D  %  D  : 

m>30  ^  m 

1.63 

V? 

1.36 

1.22 

/i 

1.07 

(2-sided  test) 

waiting  tine 
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Exanple  2.  Detection  procedures  for  Model  III:  PN^ 

Given  two  sets  of  date: 

Xj,  X2,  ...,  i.i.d.  U(0,  0j) 

Yj,  Y2,  ....  Yn  i.i.d.  U(0,  02). 

Consider  the  following  Model  Ill-type  situations: 

Case  1. 

PN':  -*2  e  fl(URP)  C0j  -  02) 

N  ♦  S:  and  X2  c  (6j  <  0 

Decide  N  ♦  S  iff  X(n)  <  mx{X(m),  Y(n)} 

Case  2. 

PN*:  ^  *X2  e  flCURP)  C®j  •  »2) 

N  ♦  S:  Xi  «nd  /2  e  00**)  C©i  >  ©2) 

Decide  N  ♦  S  iff  Y(n)  <  o1/n^1/B  nax{X(n) ,  Y(n)) 

awe  3. 

PN,:  Xl  -sf2  e  Q(URP)  (Oj  •  0j) 

N  ♦  S  Xx  iX2  UCi  «  B(WP)]  (0J  d  02) 

Decide  N  ♦  8  iff 

X(«)  nax{X(n) ,  Y(n)> 
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1 /n  M 

Y(n)  <  *ax{X(n),  Y(n)> 

Note  that  if  n  ■  * 

«1/B  (f)1^  «ax{X(*) ,  Y(n}}  -  a1/n  (|)1/n  mx{X(i),  Y(n)} 

-  o1/n  (2)1/n  hx{X(i)  ,  Y(n)} 

-  (2a)1/n  nsx{X(n),  Y(n)>, 
so  we  decide  N  ♦  S  iff 

nin{X(n),  Y(n)>  <  (2o)1/rn  nx{X(a),  Y(n)} 
ie 


■sxiXful 


Yfnj} 


>  (2a)‘ 


Purthemore,  notice  that  all  the  detection  statistics  developed  for  this 
problen  neatly  T,  Tj,  Tj,  Tj  are  equivalent  and  SOP  under  the  pure 
noise  situation.  One  could  have  used  aqr  of  the  shove  detection  procedures. 
In  this  exaq» le  detection  procedures  T  and  Ts  are  used.  The  generated 
data  and  the  application  of  the  above  detection  procedures  is  given  below. 
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Decision  Rules 


Case  1. 


PN£  versus  N  ♦  S  decide  N  ♦  S,  if  and  only  if, 

1/30  M  1/30 

Xj(30)  <  o1/3°  (§})  aax{Xj  (30) ,  X2(30)} 
-  (2o) 1/30  (2.319  •  2.0S; 


so  one  decides  in  favor  of  N  +  S. 


Case  2. 


To  detect  PN|  against  N  ♦  S  in  tills  situation  decide  N  ♦  S,  if 


and  only  if. 


i/m  m  1/50 

Xj(30)  <al/3°  (§j)  sax(Xj(30) ,  X2(30)} 


■  (2o) 1/30  (4.770)  -  4.10 


Ulus,  we  conclude  for  N  +  S. 


Case  3. 


For  detecting  PNj  against  S  ♦  N  in  this  case  one  concludes  N  ♦  S 
if  and  only  if. 


aax  (X-(30),  X.(30)>  ,/s0 

-  - - — 2 - 2 -  >  (2a)  1/30  -  1.14 


Min  (Xs(30),  X4(30)>  “ 

g  eu 

Since  T  ■  V ■  ■  1.99,  one  concludes  in  favor  of  N  ♦  S. 


The  situation  below  is  very  similar  to  a  signal  detection  problem. 


First  we  need  two  definitions. 

(a)  Epilepsy;  Chronic  disorder  of  the  central  nevous  (CNR)  system 
characterized  by  recurrent  (Multiple)  seizures  which  do  not  occur:  (i) 
only  during  hospitalization  for  an  acute  systematic  illness;  or  (ii) 
only  in  association  with  fever;  or  (iii)  as  a  result  of  development 

or  degenerative  diseases  of  the  central  nervous  system  of  CNR  infection. 

(b)  Seizure:  The  clinical  manifestation  of  abnormal  paroxysmal  discharges 
of  neurons  in  the  brain  producing  convulsive  movements  and/or  sensory, 
vegetative  or  psychic  dysfunction  with  or  without  loss  of  consiousness. 

Epileptic  seizures  were  measured  on  an  epileptic  female  patient,  whose 
age  was  12  years,  from  7:02  a.a.  to  7:02  p.a.  The  beginning  times  and 
the  duration  of  pgch  seizure  were  recorded,  fl^e  total  number  of  seizures 
was  20  for  12  hours.  We  wish  to  decide  idiether  the  inter-arrival 
times  have  a  uniform  distribution.  The  data  obtained  were  as  follows: 


Detection  of  the  Model  PN  versus  S  +  N 

PN(Hq):  The  inter-arrival  tiae  distribution  is  U(O,0)  for  some  0  >  0, 
where  ,  X2,  are  the  inter-arrival  tines  of  a  renewal  process 

and  are  i.i.d.  r«  vs. 

N  ♦  S:  Not  as  above. 

Da. a:  134,  0,  SO,  10  ,  36  ,  2,  4,  6,  10  ,  6  ,  26,  80,  9,  1,  30  ,  248  ,  26,  S, 

21,  2  (a  »  20).  Choose  PFA,  o  *  .01. 

(1)  The  Lilliefors-type  Detection  procedure. 

Me  reject  PN,  if  and  only  if,  D  ■  sup  |  F  (x)  -  F0(x) |  >  0.3S53, 

where  "0.3553"  is  the  .99th  percentile  of  the  D^  distribution  in  the 

uni fora  case  for  a  *  20,  and  is  obtained  froa  Table  1. 

In  this  case  0  ■  aax  (X.)  »  Xr,n*  ■  248;  Fft(x)  ■  x|0  «  x(248)_i 

l<j<20  3  0 

where  0  <  x  <  x^20)‘  T*1®  confutations  for  are  given  in  the  Table  5 

below.  Since  D^  ■  0.6548  >  0.3553,  we  reject  PN  situation  for  a  PFA 
of  0.01  that  the  data  is  uni fora. 


Computations  for  the  Ulliefors-type  Detection  Procedure,  DM;  Epileptic  Seizure  Data 
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(2)  The  Detection  based  on  a  M-S-N. 

In  this  case  we  reject  PN,  if  and  only  if,  D*  >  0.3014,  tdiere 
"0.3014"  is  the  .95th  percentile  of  the  Dffl_ ^  distribution  for  m  *  20 
obtained  from  the  standard  Kolmogorov- Smirnov  table.  Here,  a  M-S-N 
is  given  by  V*,  which  is  defined  as 


V*  * 

% 


•  •  •  P 


} 


1) 


h 


where  Uj,  ...,  U  j  are  i.i.d.  U(0,1)  r.  vs.  For  the  Epileptic  Seizure 
data  with  m  «  20,  one  gets 

V*  -  (0  ,  0.0040  ,  0.0081,  0  ''081,  0.0161,  0.0202, 

0.0242,  0.0242,  0.0363,  0.0403,  0.0403,  0.0847, 

0.1048,  0.1048,  0.1210,  0.1452,  0.2016,  0.3226, 

0.5403}. 


The  computations  for  D£0  are  given  in  Table  6  below,  where 


i  *  1,  2,  ..., 


19 


TABLE  6.  Computations  for  a  M-S-N  Detection  Statistic  D*; 

n 

Epileptic  Seizure  Data. 


B 

i/19 

Fe(yi)'yi 

F0^yi5'  19 

19  '  F0Cyi5 

.0526 

0.0000 

0.0526 

.1053 

-.0486 

.1013 

.1579 

-.0972 

.1498 

4 

.2105 

.0081 

-.1498 

.2024 

.2632 

.0161 

-.1944 

.2471 

.31S8 

-.2430 

.2956 

.3684 

.0242 

-.2916 

.3442 

.4211 

.0242 

-.3442 

.3969 

9 

.4737 

.0363 

-.3848 

.4374 

10 

.5263 

.0403 

-.4334 

.4860 

11 

.5789 

.0403 

-.4860 

.5386 

12 

.6316 

.0847 

-.4960 

.5469 

13 

.6842 

.1048 

-.5268 

.5794 

14 

.7368 

.1048 

-.5768 

.6320 

15 

.7895 

.1210 

-.61S8 

.6685 

16 

.8421 

.1452 

-.6443 

.6969 

17 

.8947 

.2016 

-.6405 

.6931 

18 

.9474 

.3226 

-.5721 

.6248 

19 

.5403 

—  —  ■ 

-.4071 

.4597 

Since  D*Q  -  0.6969  >  0.352, 

We  reject  the  null  hypothesis  for  a  PPA  level  of  0.01  that  the  data 
is  unifom. 

Discussion  of  the  Detection  Results 
Hie  PN  situation  is  rejected  by  all  procedures  by  a  "large  aargin". 


this  s 


to  indicate  that  the  inter-arrivals  are  decidedly  non-unifom 


